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SYMBOL POSITION MONITORING FOR PIXELATED HEADS- UP 
DISPLAY METHOD AND APPARATUS 

BACKGROUND 

[0001] The invention relates generally to control systems, and more particularly to a 
digital control data processing and display method and apparatus which verifies symbol 
positioning accuracy by receiving the positioning of a blue pixel on an LCD or other 
pixelated display, computing derived input information based on detected symbol 
position and symbol type and comparing the desired input information to the actual input 
information. 

[0002] Conventionally, methods and apparatus for verifying the operational status of 
digital control systems, specifically for flight guidance appUcations, have been used. For 
example, there have been known control system apparatuses which project a display 
symbol in the form of a light image that conveys information concerning the status of an 
operational state of the system. Such display symbols include pointers and other 
characters whose position on or direction of movement across the display screen conveys 
to the observer information about a particular operational state. 
[0003] Further, a conventional apparatus for determining whether a display symbol 
conveys the correct information includes the use of a test program which is executed 
while the control system is off-line. The test program applies known input information to 
the data processing apparatus which produces output command information in 
accordance with a known operational control function. A display symbol generator 
responds to the output command information by projecting a preassigned pointer symbol 
at a known location on the display screen. A photo detector positioned at the known 
location receives the Ught emitted fi-om the pointer symbol and thereby acknowledges the 
nominal performance of the control system after a successful execution of the test 
program. 
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[0004] These methods of verifying the operational status of the control data processing 
and display system are capable of neither verifying the status of the system in real time 
operation nor providing an adequate test for detecting latent software design defects 
which arise during the execution of a particular control operational function. 
[0005] Thus, there is a need for a symbol position and location monitoring system 
which may be used during flight operations. 

[0006] It would be desirable to provide a system and/or method that provides one or 
more of these or other advantageous features. Other features and advantages will be 
made apparent from the present specification. The teachings disclosed extend to those 
embodiments which fall within the scope of the appended claims, regardless of whether 
they accomplish one or more of the aforementioned needs. 

SUMMARY 

[0007] An example of the invention relates to an information processing system. The 
information processing system includes a first processor that receives input data and 
creates a pixel data stream provided over a first channel and a second channel. The first 
channel provides a signal to affect the output of a pixelated display. The second channel 
includes location information and symbol information. The information processing 
system also includes a second processor coupled to the first processor. The second 
processor receives the location information and the symbol information from the first 
processor. The second processor receives the input data. The second processor computes 
a derived version of the inputs based on their location information and the symbol 
information. 

[0008] Another example of the invention relates to a method of providing integrity 
checking for a pixelated display device. The method includes receiving input data by a 
first processor. The method also includes generating drawing instructions for a graphics 
engine. Further, the method includes outputting pixel data to a detector. Further still, the 
method includes receiving, by a display, at least some of the pixel data over a first 
channel. Yet further still, the method includes receiving over a second channel, by a 
symbol monitor, at least some of the pixel data and receiving the input data by the 
symbol monitor. 
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[0009] Yet another example of the invention relates to an information processing 
system. The information processing system includes a first processing means that 
receives input data and creates a pixel data stream provided over a first channel and a 
second channel. The first channel provides a signal to affect the output of a pixelated 
display and the second channel includes location information and symbol information. 
The information processing system also includes a second processing means coupled to 
the first processing means. The second processing means receives the location 
information and the symbol information from the first processing means and the second 
processing means receives the input data. The second processing means computes a 
derived version of the inputs based on the location information and the symbol 
information. 

[0010] Alternative examples and other exemplary embodiments relate to other features 
and combinations of features as may be generally recited in the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] The invention will become more fiiUy understood from the following detailed 
description, taken in conjunction with the accompanying drawings, wherein like 
reference nvimerals refer to like elements, in which: 

[0012] FIG. 1 is a generalized block diagram of an exemplary symbol monitoring 
positioning system for a heads-up display (HUD) with a pixelated display; and 
[0013] FIG. 2 is an exemplary method of providing symbol positioning monitoring for 
a heads-up display with a pixelated display. 

DETAILED DESCRIPTION OF PREFERRED AND 
EXEMPLARY EMBODIMENTS 

[0014] Before describing in detail the particular improved system and method, it should 
be observed that the invention includes, but is not limited to a novel structural 
combination of conventional data/signal processing components and communications 
circuits, and not in particular detailed configurations thereof Accordingly, the structure, 
methods, fimctions, control, and arrangement of conventional components and circuits 
have, for the most part, been illustrated in the drawings by readily imderstandable block 
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representations and schematic diagrams, in order not to obscure the disclosure with 
structural details which will be readily apparent to those skilled in the art, having the 
benefit of the description herein. Further, the invention is not limited to the particular 
embodiments depicted in the exemplary diagrams, but should be construed in accordance 
with the language in the claims. 

[0015] Referring now to FIG. 1, an exemplary control data processing system 100 is 
depicted. A symbol generator 110 receives aircraft data 115 from a plurality of sensor 
inputs and other system input data which may be delivered in either analog or digital 
form to both symbol generator 110 and to symbol monitor 120. According to an 
exemplary embodiment, aircraft data 115 may comprise aircraft sensor data. In 
accordance with altemative embodiments, aircraft data 115 may include but is not limited 
to any variety of sensor signals including the position of aerodynamic control surfaces, 
environmental variables affecting the flight of the aircraft, and/or the operating conditions 
and status of the pilot's controls. Analog data are converted into digital word format by 
analog-to-digital converters either included in or outside of symbol generator 1 10 and 
symbol monitor 120. 

[0016] When receiving aircraft data 115, symbol generator 1 10 creates a display list 
containing drawing instructions for the graphics engine 130. A conventional graphics 
engine 130 is capable of displaying the three primary colors (red, green, and blue) with 
multiple, independent intensities. In a conventional HUD, only the colors red and green 
are used. Accordingly, the blue color may be used to carry additional information. 
Graphics engine 130 processes the display list that is received from symbol generator 110 
and produces, as output, a stream of pixel data to a color detector 140. Color detector 
140 passes the red data over path 142 and the green data over path 144 to a display 150. 
Display 150 may be any of a variety of pixelated displays, including, but not limited to a 
liquid crystal display (LCD). Further, display 150 may be a heads-up or a heads-down 
display although the disclosure describes primarily the use of display 150 in a heads-up 
display configuration. Certain symbols passed to display 1 50 may be characterized as 
"critical symbols" which are critical to the operation of the aircraft, are necessary for 
critical operations of the aircraft, and/or are identified as such through certification 
standards. Each critical symbol has associated with it, an X, Y display position, as well 
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as a unique identifier or tag which identifies the type of symbol being displayed. The 
symbol generator 110 places instructions in a display list to locate the symbol in the 
correct X and Y position in the blue pixel buffer of graphics engine 130. The intensity 
level associated with the symbol is the symbols identifier or tag. Accordingly, the 
number of identifiers is limited only by the number of blue pixel intensity values and/or 
by the number of states of intensity which color detector 140 can detect. 
[0017] Color detector 140 processes the stream of pixel data from graphics engine 130 
and sends red and green pixel data to display 150 over channels 142 and 144. Blue pixel 
X and Y positions are detected by a color detector 140 and stored for access by symbol 
monitor 120. System monitor processor 120 provides verification that the symbols 
displayed are placed in the proper location and/or are the correct symbol. Each blue pixel 
intensity is used to imiquely identify the symbol being used. Symbol monitor 120 may 
also determine which symbol is being drawn and where it is being drawn from the 
information received from color detector 140. Symbol monitor 120 reads the detector 
symbol position data from color detector 140 and uses the data to determine what sensor 
input value would be required to position the symbol in that unique location. The sensor 
input values are produced through an inverse processing process. The inverse processing 
may be a matrix inversion for linear processes or an inverse function for linear or 
nonlinear relationships. Symbol monitor 120 compares the computed value with the 
actual input sensor data 115. If a miscompare is computed between display data from 
graphics engine 130 and the actual aircraft data 115, then a display path error exists, and 
the display is blanked of the symbol. Further, in an exemplary embodiment, symbol 
monitor 120 also transmits the symbol position data to test equipment extemal to the 
heads up guidance system (HGS). 

[0018] In an altemative embodiment, the display using three colored graphics, such as a 
heads down display, may utilize a fourth monitoring channel to a normal three-color 
graphics engine which would be similar to the blue channel used in the two-color 
graphics system described. Further, according to altemative embodiments, the invention 
which may be used in HGS for aircraft may also be employed in other environments such 
as, but not limited to automobiles or other vehicle systems. Such a system may be 
beneficial in autonomous vehicle control systems. Further, the invention may be 
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employed in other environments in which symbol display errors cannot be tolerated, such 
as but not limited to a surgical application in which a display is being used for the 
guidance of a surgical device, such as, but not limited to a guided probe. Also, in 
accordance with an alternative embodiment, a non-pixelated display may be used as pixel 
data may be converted to whatever format is used by the particular display type. 
[0019] Symbol monitor 120 may be an independent symbol monitor processor, that 
runs a dissimilar algorithm, and computes the state of the aircraft based on the position of 
the critical symbols. The independent symbol monitor processor 120 also compares the 
computed aircraft state with the measured aircraft data 1 15 to determine if a display path 
fault has occurred. If no miscompare exists, the display path is determined to be good, 
and the high integrity information is displayed to the pilot. 

[0020] In critical applications it is desirable for the display of information, such as 
attitude, on a HUD to meet a 10"^ integrity requirement. Further, it may be desirable for 
the display of misleading guidance on a single HUD must be less than 10'^. Further, in 
certain applications, the HUD display path must be monitored in order to meet these 
integrity requirements. Accordingly, the invention disclosed may be applied to achieve 
such goals. Further, the HUD symbol position monitoring system as described, may be 
used in conjunction with other monitoring schemes to verify that displayed symbology is 
not misleading and thus meets the certification integrity requirements. These 
requirements may be applicable for landing, take off, and other flight regimes. 
[0021] Referring now to FIG. 2, a process 200 is depicted for providing integrity 
checking for a pixelated display device. Process 200 begins by receiving input data from 
a plurality of aircraft sensors and/or systems (step 210). Drawing instructions are then 
generated based on the input data (step 220). Such instructions provide both the location 
and type of symbol to be drawn on the pixelated display. The pixel data is then output to 
a detector (step 230). The detector passes through a subset of the data to the display for 
drawing thereon (step 240). The detector then determines the symbol and its location 
(step 250). From the symbol and location detected, derived input information is 
generated by a second processing device. The derived input information is then 
compared with actual input information to determine whether it is within a tolerable 
threshold (step 280). If the derived and actual input information are not within a 
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specified threshold, the symbol is then determined to be in error and certain actions can 
be taken such as blanking the symbol from the display (step 290), blanking the entire 
display, and/or sending a warning signal of any type such as an aural, and/or visual 
warning, or the like, to the pilot. This process is carried out continuously during the 
fligjit of the aircraft or it may be implemented diuing certain critical flight segments such 
as, but not limited to take off and landing. 

[0022] While the detailed drawings, specific examples and particular formulations 
given describe preferred and exemplary embodiments, they serve the purpose of 
illustration only. The inventions disclosed are not limited to the specific forms shown. 
For example, the methods may be performed in any of a variety of sequence of steps. 
The hardware and software configurations shown and described may differ depending on 
the chosen performance characteristics and physical characteristics of the computing 
devices. For example, the type of computing device, communications bus, or processor 
used may differ. The systems and methods depicted and described are not limited to the 
precise details and conditions disclosed. Furthermore, other substitutions, modifications, 
changes, and omissions may be made in the design, operating conditions, and 
arrangement of the exemplary embodiments without departing from the scope of the 
invention as expressed in the appended claims. 



